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METHODS OF REAL TIME IMAGE 
ENHANCEMENT OF FLASH LIDAR DATA 
AND NAVIGATING A VEHICLE USING 
FLASH LIDAR DATA 

5 

CROSS-REFERENCE TO RELATED PATENT 
APPLICATIONS 

Pursuant to 35 U.S.C. §119, the benefit of priority from 
U.S. Provisional Patent Application Ser. No. 61/313,271, 10 
with a filing date of Mar. 12, 2010, is claimed for this non- 
provisional application, the contents of which are hereby 
incorporated by reference in their entirety. 

STATEMENT REGARDING FEDERALLY 15 

SPONSORED RESEARCH OR DEVELOPMENT 

The invention was made by an employee of the United 
States Government and may be manufactured and used by or 
for the Government of the United States of America for gov- 20 
emmental purposes without the payment of any royalties 
thereon or therefor. 

FIELD OF THE INVENTION 

25 

The present invention concerns a method for creating a 
Digital Elevation Map (“DEM”) from data generated by an 
apparatus relying on Light Detection and Ranging (“LI- 
DAR”) technology to generate the data. 

30 

DESCRIPTION OF THE RELATED ART 

LIDAR is known for its ability to generate 2-dimensionsal 
(“2-D”) images of geographic surface features. 

In addition, flash LIDARs are able to generate, in real-time, 35 
range data that can be interpreted as a 3-dimensional (“3-D”) 
image. Since the output from flash LIDARs includes range 
data, the output signals can be transfomied into a correspond- 
ing DEM. 

The Autonomous Landing and Hazard Avoidance Technol- 40 
ogy (“ALHAT”) has been developing, testing and analyzing 
flash LIDARs to detect hazardous terrain features such as 
craters, rocks, and slopes during the descent phase of space- 
craft landings. 

Through theoretical and simulation analysis, it has been 45 
determined that a single frame or mosaic of flash LIDAR data 
may not be sufficient to build a landing site DEM with accept- 
able spatial resolution, precision, and size. Also, it has been 
determined that a single frame of LIDAR data is insufficient 
to generate a mosaic to meet current system requirements. 50 

A need, therefore, has developed for a method to overcome 
this potential limitation and also to provide additional 
enhancements, as set forth in greater detail below. 

SUMMARY OF THE INVENTION 55 

It is one aspect of the present invention to provide an image 
processing technique, applicable to flash LIDAR data, to 
enhance the flash LIDAR data, permitting the generation of a 
DEM of sufficient quality and resolution to enable safe and 60 
precise spacecraft landings for robotic and/or crewed lunar 
and planetary missions. 

In another embodiment of the present invention, a super- 
resolution algorithm applicable to flash LIDAR range data 
that assists with the creation of a DEM with sufficient accu- 65 
racy, precision and size to meet current ALHAT requirements 
is disclosed. 
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In yet another embodiment of the present invention, the 
performance of the super-resolution algorithm was analyzed 
by processing data generated during a series of simulation 
runs using a high fidelity model of flash LIDAR imaging of a 
high resolution synthetic lunar elevation map. 

In still another embodiment of the present invention, the 
perfonnance of flash LIDAR is evaluated. A flash LIDAR 
model was attached to a simulated spacecraft via a gimbal that 
pointed the LIDAR to a target landing site. For each simula- 
tion run, as the spacecraft descended to the landing site, a 
sequence of flash LIDAR frames was recorded and processed. 
Each run was provided with a different traj ectory profile, with 
varying LIDAR look angles of the terrain. 

In another embodiment of the present invention, the 
LIDAR frame output was processed using a super-resolution 
(“SR”) algorithm, which forms part of the present invention. 
The results of the analyses show that the level of accuracy and 
precision of the SR generated landing site DEM, with respect 
to detecting hazardous terrain features and identifying safe 
areas, offers an improvement over results available through 
available techniques. 

In yet another embodiment, the present invention also capi- 
talizes upon the ability to generate an optical offset between 
successive frames of flash LIDAR data. The offset may be 
provided as input for a system that provides guidance, navi- 
gation, and control of a vehicle, such as a spacecraft. In this 
contemplated embodiment of the invention, it is not necessary 
to generate a DEM. This second method may be utilized in 
combination with the generation of a DEM when controlling 
a vehicle, such as a spacecraft. It is, therefore, an aspect of the 
present invention to rely on flash LIDAR data for guidance, 
navigation, and control of a vehicle. 

It is also an aspect of the present invention to provide real 
time image enhancement of flash LIDAR data. 

Other aspects of the present invention will be made appar- 
ent from the discussion that follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a perspective, schematic illustrating aspects of 
one embodiment of the present invention, illustrating a sur- 
face S to be measured by flash LIDAR; 

FIG. 2 is a side view illustration of the schematic of FIG. 1, 
providing additional clarification of the variables identified; 

FIG. 3 graphically depicts the Average Residual data with 
respect to Frame Number for a first test case associated with 
the present invention; 

FIG. 4 graphically depicts the Standard Deviation of the 
Residual (Residual STD) data with respect to Frame Number 
for a first test case associated with the present invention; 

FIG. 5 graphically depicts the Correlation Coefficient data 
with respect to Frame Number for a first test case associated 
with the present invention; 

FIG. 6 graphically compares the Mean Residual data with 
respect to Frame Number for a second test case associated 
with the present invention; 

FIG. 7 graphically compares the Residual STD data with 
respect to Frame Number for a second test case associated 
with the present invention; 

FIG. 8 graphically compares the Correlation Coefficient 
data with respect to Frame Number for a second test case 
associated with the present invention; 

FIG. 9 graphically depicts the Correlation Coefficient data 
with respect to Frame Number for a third test case associated 
with the present invention; 
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FIG. 10 graphically depicts the Average Residual data with 
respect to Frame Number for a third test case associated with 
the present invention; 

FIG. 11 graphically depicts the Residual STD data with 
respect o Frame Number for a third test case associated with 
the present invention; 

FIG. 12 graphically depicts the Correlation Coefficient 
data with respect to Frame Number for a fourth test case 
associated with the present invention; 

FIG. 13 graphically depicts the Average Residual data with 
respect to Frame Number for a fourth test case associated with 
the present invention; 

FIG. 14 graphically depicts the Residual STD data with 
respect to Frame Number for a fourth test case associated with 
the present invention; 

FIGS. 15-16 provide a flow chart for a first method accord- 
ing to the present invention; 

FIG. 17 provides a schematic overview of one implemen- 
tation of the method depicted in FIGS. 15-16 on a vehicle, 
such as a spacecraft; 

FIGS. 18-20 provide a flow chart for a method according to 
the present invention; and 

FIGS. 21-22 provide a flow chart for a method of real time 
image enhancement according to the present invention. 

DETAILED DESCRIPTION OF EMBODIMENTS 

The present invention is now described in connection with 
the generation of DEMs for extraterrestrial landings, i.e., 
lunar landings and landing on other bodies within the solar 
system. While discussed in this context, it is noted that the 
invention is not limited to extraterrestrial geography but may 
be employed for terrestrial mapping as well. Additionally, the 
present invention may be employed on any device, such as a 
robotic arm, that is guided using flash LIDAR data. 

In addition, the present invention is described in connec- 
tion with one or more embodiments. The present invention, 
however, is not intended to be limited only to the embodi- 
ments described. To the contrary, those skilled in the art will 
readily appreciate that there are numerous equivalents and 
variations that may be employed consistently with the discus- 
sion of the present invention. Those equivalents and varia- 
tions are intended to be encompassed by the present inven- 
tion. 

With respect to the present invention, the term super-reso- 
lution (“SR”), as applied to image reconstruction (rather than 
optical diffraction limited SR techniques), generally refers to 
the group of signal processing algorithms that improve the 
spatial resolution of an image to better than the size of the 
pixel of the original image. The SR techniques and algorithms 
of the present invention are implemented by taking advantage 
of sub-pixel shifts between multiple, low-resolution images 
of the same scene. 

Historically, SR algorithms were developed for two-di- 
mensional (“2-D”) image processing. 

As should be apparent to those skilled in the art, LIDAR 
imaging technology is capable of generating, in real-time, 
both 2-D intensity data and also range data. Together, the 2-D 
intensity data and the range data may be interpreted as a 
three-dimensional (“3-D”) image. This dual aspect of LIDAR 
data underlies, at least in part, the present invention. 

Hie Autonomous Landing and Hazard Avoidance Technol- 
ogy (“ALHAT”) project has been developing, testing and 
analyzing flash LIDARs to detect hazardous terrain features 
such as craters, rocks, and slopes during the descent phase of 
spacecraft landings. 
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Through theoretical and simulation analysis, it lias been 
determined that a single frame of flash LIDAR data may not 
be sufficient to build a landing site digital elevation map 
(“DEM”) with acceptable spatial resolution, precision and 
5 size to meet current system requirements. 

In addition, existing technologies are not likely to be able to 
construct a DEM of sufficient quality and precision within the 
short time window available during a landing. During the 
landing of a vehicle, the total time available for processing 
to data is quite brief. Existing technologies require processing 
that hinders or prevents the generation of a DEM of sufficient 
quality during the time period for spacecraft landing 

The present invention recognizes that the application of SR 
image enhancement techniques to flash LIDAR 3-D output 
15 images permits the generation of DEM with sufficient quality 
in a sufficiently short period of time to be useable by a space- 
craft during a landing procedure. 

To the extent that flash LIDAR enhancements have been 
addressed, flash LIDAR images are treated as a sequence of 
20 uncorrelated images. Moreover, the 3-D character of the data 
has not been exploited. As noted above, the 3-D character of 
the data includes, among other aspects, the 2-D intensity data 
and the range data inherent in the LIDAR output. 

The present invention encompasses an SR algorithm that is 
25 applied to flash LIDAR data, specifically the range data, 
permitting the creation, quickly and effectively, of a DEM 
with sufficient accuracy, precision and size. 

As a part of the development of the algorithm(s) applying 
SR to LIDAR data to create a DEM, the inventors analyzed 
30 the performance of the algorithm by generating data from a 
high fidelity model of a flash LIDAR system containing 
parameters for various sensor functions and noise sources. 
The flash LIDAR model was embedded in a full end-to-end 
landing simulation device, which was attached to a gimbal on 
35 a spacecraft model. The spacecraft model was subjected to 
varying trajectories while “flying” to a mock lunar landing 
site. 

In the model, the gimbal on the spacecraft pointed the flash 
LIDAR to a target landing site throughout the trajectory of the 
40 spacecraft . During descent of the spacecraft, the flash LIDAR 
illuminated a high-resolution synthetic lunar elevation map, 
processed the returned laser light within the field of view of 
the sensor, and outputted the calculated sensor range data. 
The range images returned by the model were processed 
45 using the SR algorithm of the present invention and a landing 
site DEM was generated. 

The results of the modeling showed that the achieved level 
of accuracy and precision of the SR generated DEM was more 
than adequate for detecting hazardous terrain features and 
50 identifying safe areas. 

Flash LIDARs generally transmit a relatively wide diver- 
gence, pulsed laser beam that illuminates a target surface. The 
reflected laser light, together with any ambient light in the 
field of view (“FOV”) of the optical sensor, is received via an 
55 optical subsystem, is detected by a focal plane array (“FPA”), 
is translated into electrical signals by a readout integrated 
circuit (“ROIC”), and is timed and processed on a per pixel 
basis to generate time-of-flight range measurements. These 
range measurements can be interpreted as a 3-D image and 
60 transformed into a corresponding DEM. The relative intensi- 
ties of the returned signals are also measured and can be used 
to generate an intensity image. 

In one example, the flash LIDAR system relies on a pulsed 
laser working at 1.5 micron (pm) wavelengths and a 128x128 
65 FPA. It is noted, however, that higher power lasers, operating 
at more responsive wavelengths (i.e., 1 .06 micron (pm)), and 
incorporating a laiger 256x256 FPA and ROIC may be 
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TABLE 1 


5 

employed without departing from the scope of the present 
invention. In fact, it is anticipated that, as higher power sys- 
tems are developed, they will be employed in future systems 
embodying the present invention. 

One embodiment of the simulation environment that illus- 5 
trates the model context and interfaces of the present inven- 
tion is shown in FIG. 17. The flash LIDAR model (i.e., the 
model spacecraft) interacts with a hi-resolution simulated 
lunar terrain via a mapping and raytrace routine. Multiple 
rays are assigned to each pixel within the FPA of the model. 10 
The ray-trace routine is used to interrogate the lunar terrain 
within the ground footprint of the sensor. 

A ground footprint is generated for both the transmitter and 
receiver from several parameters, such as the laser beam 1? 
divergence, receiver FOV, and the model’s attitude and posi- 
tion, which are derived from the spacecraft slant range, path 
angle and gimbal orientation. Range and surface reflectivity 
data for each ray are returned to the core processing code of 
the model. 20 

Based on this input infonnation, the model implements a 
standard convolution imaging equation, which is set forth 
below as Equation (1): 

%(x,y,t)=p(x,y,t®e(x,y,t)+r)(t) (1) 25 

In Equation (1), t, is the output signal, p is the point spread 
function that represents the LIDAR temporal pulse profile, 0 
is the object function that describes how the transmitter 
energy is scattered in amplitude and time, and r| is the total , f) 
noise sum of various random processes such as detector dark 
noise. Johnson noise and shot noise. Range information is 
generated on a per pixel basis by signal reconstruction algo- 
rithms. For ALHAT, the range data is then transformed into an 
angle-angle-range format and transferred to either a hazard 35 
detection or hazard relative navigation algorithm. These algo- 
rithms produce maps that are fed into a GNC algorithm, 
which controls the motion of the spacecraft. 

The flash LIDAR model includes several parameters that 
can be adjusted to enable simulation of a wide variety of 40 
sensor specifications. Example parameters include, but are 
not limited to, instantaneous field of view (“IFOV”), receiver 
aperture, laser power, beam divergence, and sample rate. The 
parameters are loaded from an i-load file into the model 
before a simulation run and can be adjusted to enable a Monte 45 
Carlo-type simulation. 

The following steps are performed to setup and generate 
data to test the super-resolution algorithm of the present 
invention. 

First, a spacecraft trajectory was generated for 90° and 45° 50 
path angles with an initial slant range of 1000 m and a trajec- 
tory that descends linearly down to 100 m. In generating this 
trajectory, the following assumptions were made: the space- 
craft was assumed to move from the beginning to the end of its 
trajectory in 30 seconds and the frame rate of the LIDAR was 55 
20 Hz, effectively resulting in a new image being taken at 
every 1.5 m of descent. In this simulation, the gimbal was 
programmed to point at the target landing site throughout the 
trajectory except where random noise was injected on specific 
axes to test the SR algorithm. 60 

Second, an i-load file for the model was created with base- 
line sensor parameters. For example the FPA was set to 128x 
128 pixels and the range precision was set to 5 cm. The IFOV, 
receiver aperture, and transmitter beam divergence were 
adjusted during the descent as shown in Table 1 (below) to 65 
simulate zoom optics adjustments that may be made to keep 
roughly the same ground footprint throughout the trajectory. 


Slant 

Range 

(m) 

IFOV 

(rads) 

Receiver 

Aperture 

(rads) 

Transmitter 
Beam Divergence 
(rads) 

1000 

0.00040 

0.05 

0.0512 

750 

0.00053 

0.0375 

0.0678 

500 

0.00080 

0.025 

0.1024 

250 

0.00160 

0.0125 

0.2048 


Third, a synthetic lunar map with a 10 cm posting was 
loaded into the simulation as the representative landing site 
target for the spacecraft equipped with the LIDAR system. 
The map had an area of approximately 450x450 m, and 
mini mum and maximum map height data of -9.4 m and +4.87 
m respectively. After setup was complete, the simulation was 
executed and range output images were generated for each 
trigger point throughout the trajectory. 

The back project method underlying the present invention 
will now be discussed. The term “back projection” is com- 
monly used in the area of linear X-ray tomography in which 
the measured signals are ID or 2-D projections of 2-D or 3-D 
objects, respectively. Calculation of the projections, i.e., solv- 
ing the direct problem, is performed by integrating an object 
quantity feature, for example density, along the X-ray path. 
Back projection, i.e., solving the inverse problem, occurs via 
a reconstruction technique where the properties of projec- 
tions are translated hack into the object following the X-ray 
path in the inverse direction. 

Among other aspects, the present invention capitalizes on 
the fact that this back projection method also may be applied 
to flash LIDAR data. Using the back projection method for 
flash LIDAR data implies a model of the measuring process 
where the following is valid: the range recorded by a detector 
is the average of the ranges from the detector location to the 
each point on the reflecting surface, which is located inside of 
the detector FOV as described by the following equation: 


/?,(*!, x 2 ) = l /s, x 



( 2 ) 


where R, is the range recorded by detector number i; R(x, y) 
is the range from the point with coordinates (x, y) on the 
surface, S ( , to the detector; and £2, is the domain on the surface 
corresponding to the detector FOV. In fact, £2, is the proj ection 
of the FOV on the flat plane, and S ; is the area of this domain 
as shown in FIGS. 1 and 2 . This model is an approximation, 
and the level of accuracy of this approximation can be tested 
after the inverse problem is solved. 

The purpose of the SR method of the present invention is to 
deter mine elevations on a mesh with cells smaller than Q. If 
0 is defined as a fine rectangular mesh with pixel sizes that 
meet specified requirement, then Equation (2) can be rewrit- 
ten as Equation (3), which is presented below: 



(3) 


where k denotes the number of cells on the mesh 0 that 
overlap with the projection £2,., and Nj. is the number of such 
cells, Equation (3) is a first approximation to Equation (2). 
Weighting factors may be included to increase the accuracy of 
the formula. The geometry of the back proj ection procedure is 
illustrated in FIGS. 1 and 2 . 
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In one contemplated embodiment of the present invention, 
the algorithm is executed by performing the following steps: 

Step 1 : The SR elevation map is initialized as the fine mesh 
0. Then, arrays S, M and D are created. Arrays S(k) and M(k) 
are working arrays with dimensions the same as 0. Index k is 
a 3-D index into the fine mesh 0. Array D(k) contains the 
algorithm output — the elevation map on the fine mesh. All 
arrays are initialized to zero. 

Step 2: For each frame and for each individual detector of 
the FPA, the projection of the FOV on the reference surface 
(zero elevation level) is determined. 

Step 3: The set of cells from 0 that overlap with this 
projection are found. Using the center of the cell from 0 as 
one point, the one point is comiected to the detector by a 
straight line and the distance is calculated. 

Step 4: The difference between the calculated distance and 
the range registered by the detector indicates the location of 
the point where the ray crosses the surface. The elevation of 
this point is calculated by the formula: 

hkr&k-Rt )* sin e i (4) 

Points k and k, may be the same or different depending on the 
angle of incidence. 

Step 5: The arrays S and M are updated according to the 
following: 

M(k l )=M(k i )+ 1 (5) 

Step 6: This operation continues for all detectors in the 
current frame. Then, the following normalization procedure 
is applied: 

Dk=S(k)IM{k) for all k (6) 

Step 7: Finally, steps two through six are repeated for all 
frames of the data. The DEM may be constructed after 
completion of these seven steps. 

Several computational experiments were performed to test 
the SR procedure of the present invention. These experiments 
focused primarily on construction of a DEM with sub-pixel 
resolution using data collected from various trajectories. All 
tests were perfonned using five basic steps: 

Step 1 : A simulated spacecraft trajectory and select a target 
map were generated. 

Step 2: The generation of flash LIDAR data (frames) 
throughout the trajectory was generated. 

Step 3: Controlled, random noise was added to all of the 
frames. 

Step 4: The back projection method was appliedto the data 
and the restored DEM was constructed. 

Step 5: Finally, the original “true” frames were compared 
with the constructed DEMs using basic statistical metrics. 

First Test Case 

In a first test case and in all subsequent test cases, the model 
of the flash LIDAR was used to generate the simulated 
LIDAR data. The original map was chosen from a synthetic 
lunar terrain database in POST II. Hie map was classified as 
a smooth m are terrain type with 10% rock abundance. The 
LIDAR input map was created from a portion of the original 
lunar map on a rectangular grid with 1024x1024 pixels. 
LIDAR data were generated using a nadir (90°) approach 
trajectory to this map starting with a slant range of 1000 m 
descending down to 100 m. The sizes of the frames were 
128x128 pixels. Zoom optics were implemented, as previ- 
ously discussed, with zoom changes as shown in Table 1 . A 
low resolution DEM was generated using only the first frame 
of the data. 
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The back proj ection algorithm of the present invention was 
then applied using the first 160 frames. Using the present 
invention, it was found that the restored high resolution map 
showed dramatically improved image quality. The results of 
5 changes in the mean residual, residual STD, and correlation 
coefficients for the maps are shown in FIGS. 3 , 4 , and 5 , 
respectively. As is apparent from these figures, minimal 
increases in image quality are gained after only a few frames 
of data. Convergence appears to have been reached after 
to about 30 frames of data as illustrated by the asymptotic nature 
of the graphs provided. 

Second Test Case 

Fora second test case, the synthetic flash LIDAR data were 
generated using the same set of LIDAR parameters, optical 
15 zoom changes, and map that are discussed above in connec- 
tion with the First Test Case. The spacecraft trajectory also 
was the same except that a simulated jitter was injected onto 
the spacecraft by applying a normally distributed random 
variable with zero mean and a standard deviation of 0.1° 
20 (1 .745 mrads) along the spacecraft’s z-axis. 

The mean of the residual, standard deviation of residual, 
and correlation coefficient, all calculated between the true 
and restored maps are shown in FIGS. 6, 7, and 8. The results 
indicate a slight improvement in the performance of the SR 
25 algorithm of the present invention when jitter is applied to the 
flash LIDAR, and thus subsequent output data, than without 
jitter. This is due to the inherent nature of SR processing 
which takes advantage of any slight misalignment in corre- 
lated images. Thus, this type motion presents an advantage, 
30 since any real spacecraft will have some level of jitter during 
operation. 

Third Test Case 

In a third test case, the synthetic flash LIDAR data was 
generated using the same set of LIDAR parameters, optical 
35 zoom changes, and map that were used in the First Test Case. 
Simulated jitter was removed in this Third Test Case and a 
new, initial 45° incidence angle trajectory was flown by the 
simulated spacecraft. The spacecraft moved from =700 m 
down to 250 m in altitude (z-axis), while the slant range 
40 decreased from 1 000 m down to 100 m. 

In this Third Test Case, the iteration interval used for pro- 
cessing was 50 frames. The correlation coefficient, mean 
residual, and standard deviation between the original and 
restored images are shown in FIGS. 9 , 10 , and 11 . The initial 
45 noise level on the ranges was 10 cm and the measurements 
contained a significant number of dropouts. After SRprocess- 
ing, the standard deviation of the residual between the origi- 
nal “true” map and the restored map was improved to =5 cm. 

Fourth Test Case 

50 In a fourth test case, the synthetic flash LIDAR data was 
generated using the same set of LIDAR parameters, optical 
zoom changes, and map that were used in the Second Test 
Case. The trajectory flown by the simulated spacecraft was 
modified to have a challenging 15° incidence angle. Again, 
55 the SR algorithm of the present invention was applied to the 
areas that were covered by the LIDAR footprint. The restored 
DEM, using iteration intervals of 1 and 50 frames, showed an 
increased image quality. Even for this shallow angle trajec- 
tory, the SR algorithm of the present invention provided sig- 
60 nificant improvement. The correlation coefficient, mean 
residual, and standard deviation between original and 
restored images are for this Fourth Test Case are provided in 
FIGS. 12 , 13 , and 14 . These statistics corroborate previous 
results. 

65 As discussed above, the present invention was imple- 
mented on a spacecraft model flying various, simulated, land- 
ing trajectories. The gimbal pointed the LIDAR to a target 
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landing site throughout the trajectory. The flash LIDAR illu- 
minated a synthetic lunar terrain, processed the returned sig- 
nal with typical sensor noise characteristics, and output a 
range image which was subsequently processed by the SR 
algorithm of the present invention. Original, input maps to the 
LIDAR, and the processed SR maps were evaluated for visual 
quality and compared with basic statistical measures. 

The results show that the algorithm of the present invention 
improves the spatial resolution of noisy, low resolution flash 
LIDAR images and provides a high level of accuracy and 
precision in the final output DEMs . The present invention also 
proves to be robust when applied to different viewing angles. 
The present invention also may be implemented in real time 
using current, commercial-off-the shelf hardware processors. 
The production of high quality imagery and the potential for 
real-time implementation shows significant promise for use 
within the ALH AT system. Combined together with an ortho- 
rectification algorithm, and a hazard detection/hazard relative 
navigation algorithm, the SR algorithm of the present inven- 
tion may be used to provide a critical component for perform- 
ing autonomous and safe landings. 

The back projection method (SR algorithm) of the present 
invention will now be discussed in greater detail. 

FIG. 1 is a perspective schematic that illustrates the 
approach taken with respect to the present invention. A detec- 
tor 10 and an emitter 12 are shown. The detector 10 and the 
emitter 12 are understood to be integrated into a spacecraft, 
the details of which are not shown. As should be apparent, the 
present invention may be applied to any vehicle regardless of 
its construction. The emitter 12 emits laser light that is 
directed to a geographic surface 14 . The geographic surface 
14 , at least for purposes of discussion, represents a field of 
view of the detector 10 and also is a portion of a landscape, 
such as a lunar landscape. 

It is noted that the detector 10 tested as a part of the 
development of the present invention incorporated a detector 
10 with a 128x128 array of detector pixels, each of which are 
represented by the designation i. In other words, the detector 
incorporated 16,384 detector pixels. For purposes of the 
present invention, it may be said that the invention incorpo- 
rates a plurality of detectors i, each of which corresponds to an 
individual pixel in the detector array. The exact number of 
detector pixels i is not critical to operation of the present 
invention and any number maybe employed without depart- 
ing from the scope of the present invention. 

Light emitted from the emitter 12 reflects from the surface 
14 and, as a reflected light ray 16 , is detected by each of the 
detector pixels i in the detector 10 . As should be apparent to 
those skilled in the art, the detector 10 may be any suitable 
type of detector that incorporates electronics capable of gen- 
erating a two dimensional (or three dimensional) pixel map 
that represents the data presented by the reflected light ray 16 . 
The detector 10 , therefore, may be any suitable type of digital 
device, as should be known to those skilled in the art. The 
output from the detector 10 is referred to herein as a frame of 
data. As should be apparent to those skilled in the art, a frame 
of data typically comprises a two dimensional array of digital 
data. The array of digital data may be redtangular, square, or 
any other suitable shape, as required or as desired. 

In the present invention, the frame of data includes range 
data R from the detector 10 to the surface 14 within the field 
of view of the detector 10 . As should be apparent, for each 
pixel i in the frame of LIDAR data, there will be an associated 
range R, between the detector 10 and the surface 14 . 

In the context of the detector 10 discussed above, each 
pixel i in the data array will have a corresponding range 1 6, R, 
that is associated with a coordinate S, on the surface 14 that 
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has been sampled. In the context of the present invention, the 
different ranges for the array are designated R(x, y). Alterna- 
tively, the ranges are referred to herein at R,. R, is used to 
abbreviate reference to any particular pixel in the array, with 
5 the understanding that each pixel in the array is given a unique 
number i that identifies the detector i associated with a spe- 
cific geographic location (x, y). In other words, the LIDAR 
frame of data will include i pixels, each of which corresponds 
to an area S ; . on the lunar surface (in this one example). “S” 
to also is used to refer to the surface 14 for mathematical pur- 
poses. 

As further definitional background to the present inven- 
tion, and with continued reference to FIG. 1, an elevation map 
0 (which is also designated as map 18 ) is defined. The eleva- 
15 tion map 0 includes a number of cells k. The plurality of cells 
k define an array of values with AxB pixels. The array may be 
square, such that A=B. Alternatively, the array may be rect- 
angular such that A>B. Other variations also may be 
employed without departing from the scope of the present 
20 invention. In the context of the present invention, the mesh 0 
was defined as an array of 1024x1024 pixels. As a result, for 
at least one embodiment of the present invention k»i (i.e., 
1024»128). 

As should be apparent from the foregoing, the number of 
25 pixels k may not be the same as the number of detectors i. 
There may be a larger or fewer number of pixels k in the 
elevation map 18 than there are detectors i that generate the 
flash frame of LIDAR data. Alternatively, there may be a 
larger number of areas S, than cells k in the map. Naturally, the 
30 number of areas S, for the surface 14 will correspond with the 
number of pixels i in the detector 10. 

Once the elevation map 18 is defined, typically as a zero 
elevation, a range may be calculated from the elevation map 
18 to the detector along a ray 20 . The ray 20 is shown in FIG. 
35 1 . The ray 20 is the distance from the detector to the elevation 
map 18 . As illustrated in FIG. 1 , the range 16 from the detec- 
tor 10 to the surface 14 is the distance from the detector 10 to 
a first point 22 on the surface 14 . The length of the ray 20 from 
the detector to the elevation map 1 8 is the calculated distance 
40 from the detector 1 0 to a second point 24 on the elevation map 
18 . As should be apparent, once the first point 22 and the 
second point 24 are defined, it is possible to calculate a 
distance 26 between the first point 22 and the second point 24 . 
This distance is referred to as a height h. The height h permits 
45 generation of the DEM. 

Having defined the variables, reference is now made to 
FIGS. 15 - 16 , which illustrate the back projection method of 
the present invention for generation of a DEM of sufficient 
quality for use on or with a vehicle such as a spacecraft. 

50 The back projection method 30 of the present invention 
will now be described in terms of various steps that are iden- 
tified in FIGS. 15 - 16 . It is noted that the definition of the steps 
is not intended to be limiting of the present invention. One or 
more of the steps may be combined with others of the steps 
55 without departing from the scope of the present invention. In 
other words, the definition of a “step” is not intended to be 
limiting of the present invention. The use of steps is employed 
merely as an example of one contemplated embodiment of the 
present invention. 

60 As illustrated in FIG. 15 , the back projection method, 
which permits the generation of a DEM of sufficient quality, 
starts at step 32 . At step 34 , light is emitted from an emitter 12 
that is part of the flash LIDAR apparatus incorporated into the 
vehicle. The emitted light is directed to the surface 14 . Light 
65 reflected from the surface 14 returns to the detector 10 . The 
reflected light travels along the reflected light ray 16 to the 
detector 10 and detected by the detector pixels (also referred 
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to as the detectors) i. At step 36, the reflected light ray 16 is 
captured by the detector pixels i in the detector 10. 

With respect to the method 30, it is noted that a single 
detector i is discussed. The detector i is intended to refer to a 
single detector pixel i or to the array of detector pixels i. 
Discussion of the method 30 is made with respect to a single 
pixel, but it is to be understood that the discussion applies to 
the array of pixels as already noted. 

At step 38, a frame of data is generated from the captured 
light by the detector 10. The frame of data is a digital frame of 
data that includes, among other aspects of the surface S, a 
range R ; distance for each pixel i. While the contemplated 
embodiment relies upon a processor incorporated into the 
detector 10 to generate the frame of data, the processor need 
not be a part of the detector 10. To the contrary, the processor 
10 may be a component separate from the detector 10 without 
departing from the scope of the present invention. 

As noted the frame of data generated by the detector 10 
includes a range 16, R ( , which is measured as the distance 
from the detector 10 to a first point 22 on the surface S. As 
should be apparent, the range 16 will be a plurality of ranges 
R„ one for each pixel i. 

At step 40, an elevation map with a mesh 0 is defined. The 
mesh 0 typically will be defined by a processor associated 
with the detector 10. The mesh 0 includes a number of cells 
k. In one embodiment contemplated for the present invention, 
the cells k are arranged in a 1024x1024 array, as discussed 
above. 

Once the mesh 0, which is understood as a fine mesh, has 
been defined, the method 30 proceeds to step 42. In this step, 
three arrays are initialized. The three arrays are a first array 
S(k), which corresponds to the array for the surface 14, S„ a 
second array M(k), which corresponds to an elevation map 18 
for the mesh 0, and a third array D(k) that receives output and 
corresponds to the DEM generated from the frame data pro- 
cessed by the SR algorithm for the present invention. As 
noted, the value k corresponds to the cells k that make up the 
mesh 0. 

The method 30 then proceeds to step 44, where the surface 
14 is projected onto the mesh 0 that overlaps with the pro- 
jection. By this process, as should be apparent from the dis- 
cussion above, the array of i values that correspond to the 
number of detectors i are increased, at least in this embodi- 
ment, to an array of k values corresponding to the number of 
cells k in the mesh 0. 

At step 46, the set of cells k that overlap with the projection 
are selected. 

FIG. 15 includes a transition block A, labeled with the 
reference number 48, that provides a transition to the remain- 
der of the method 30 illustrated in FIG. 16. The transition 
block appears at the top of FIG. 16. 

With reference to FIG. 16, the method 30 continues to step 
50 where a second distance Rj. is calculated. The second 
distance or range R A . is calculated as a distance from the 
second point 24 on the mesh 0 to the detector 10. This 
distance or range Rj. is labeled as the ray 20 in FIGS. 1 and 2, 
as identified above. 

Having established the ranges 16, R, and 20, Rj., the method 
30 proceeds to step 52 where the height h fa is calculated 
according to the equation: 

A*i=Wt-jyxsm e, (4) 

The height h t , is identified as the line 26 in FIGS. 1 and 2 for 
clarity. The angle 0 is denoted in FIG. 2. 

Hie method then proceeds to step 54, where the first array 
S(k) and the second array M(k) are updated. This is done via 
the following equations: 


S(k t ) S(7; ( | 

M(i 1 )=M(ii)+ 1 (5) 

As noted above, the first array S(k) and the second array M(k) 
5 were initialized to zero. Having processed the flash LIDAR 
data as discussed above, the values are now updated to incor- 
porate the calculated data. 

The method 30 then proceeds to step 56, where the third 
data array D(k) is normalized using the updated values for the 
to first array S(k) and the second array M(k). 

The method 30 then ends at step 58. 

It is noted that the steps identified above represent one 
iteration of the sampling of frames of flash LIDAR data 
generated by the detector 10. As discussed above, if a latger 
1 5 number of frames of LIDAR data are employed, the accuracy 
of the DEM is increased. As noted above, it is anticipated that, 
if about 30 frames of LIDAR data are used, a DEM of suffi- 
cient quality can be produced. Since the detector 10 of this 
embodiment of the present invention operates at a frequency 
20 of 30 Hz, it is possible to create a DEM of sufficient quality 
from 30 frames of LIDAR data in one second, whichresults in 
the creation of a DEM in real time. As should be apparent to 
those skilled in the art, a larger or smaller number of frames of 
LIDAR data may be employed, as required or as desired. 

25 It is noted that the sampling rate of 30 Hz is merely the rate 
contemplated for one embodiment of the present invention. A 
larger or a smaller sampling rate may be employed without 
departing from the scope of the present invention. 

Reference is now made to FIG. 17. FIG. 17 provides a 
30 schematic overview of an operation diagram 60 of a vehicle 
according to the present invention. The flash LIDAR 62 of the 
present invention receives information about the terrain 64 in 
the manner discussed above, by emitting laser light and cap- 
turing reflected light from the terrain or surface 14. In addi- 
35 tion, the flash LIDAR apparatus 62 also receives sensor 
parameters 66 that include, but are not limited to, instanta- 
neous field of view (“IFOV”), receiver aperture, laser power, 
beam divergence, and sample rate. Other parameters that may 
be received include, but are not limited to, the vehicle’s atti- 
40 hide and position, which are derived from the spacecraft’s 
slant range, path angle and gimbal orientation. 

The data is then processed to transfonn the data, via the 
transformation processor 68 to generate the DEM. The DEM 
may then be provided to a hazard detection algorithm proces- 
45 sor 70 and the output may be provided to a guidance, naviga- 
tion, and control processor 72 that controls the operation of 
the vehicle. Separately, a visualization of the processors 74 
may be outputted . The visualization may be a digital elevation 
map or an equivalent for additional processing or generation 
50 of a visual representation of the surface terrain 14. 

The operational schematic 60 illustrated in FIG. 17 pro- 
vides a starting point to discuss at least a second aspect of the 
present invention, which is directed to the navigation of a 
vehicle, such as a spacecraft, using the flash LIDAR data. 

55 It is recognized that the creation of a DEM is not required 
for operation of a vehicle such as a spacecraft. To the contrary, 
the data processed by the vehicle on a frame by frame basis 
can provide significant information for guiding and control- 
ling the vehicle even the absence of the generation of a DEM 
60 of sufficient quality. 

A general overview of the guidance, navigation, and con- 
trol (“GNC”) of the vehicle will be provided before describ- 
ing one embodiment of the method contemplated for the 
present invention. 

65 As discussed above, the flash LIDAR apparatus generate 
frames of flash LIDAR data at a rate of 30 Hz, at least in one 
embodiment of the present invention. Therefore, each frame 
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of LIDAR data has associated with it a predetermined time 
index of Vw of a second. When subsequent frames of LIDAR 
data are correlated with one another, therefore, it is possible to 
appreciate the change between frames of LIDAR data for 
each time interval. This provides data concerning the speed 5 
and position of the vehicle with respect to a selected area (i .e., 
a reference area) on the surface 14. As a result, it becomes 
possible to generate parameters for input to a GNC processor 
for the vehicle to control the vehicle in its descent to the 
surface 14. In other words, the DEM does not need to be 10 
generated for input to the GNC processor. Instead, an offset 
(otherwise referred to as an optical flow) between frames of 
LIDAR data can be used as input to a GNC processor. This 
operation may be employed in combination with the genera- ; . 
tion of the DEM, as discussed above, for control of a vehicle 
according to the present invention. 

A method 80 of navigating a vehicle will now be described 
in connection with FIGS. 18-20. 

FIG. 18 illustrates a method 80 for navigating a vehicle. 20 
The method 80 starts at 82. At step 84, light is emitted from an 
emitter 12 to a surface 14. This step is consistent with step 34 
of the method 30 described above. At step 86, light reflected 
from the surface is captured by the array of detectors i that are 
a part of the detector 10 of the flash LIDAR apparatus, the 25 
details of which are provided above. At step 88, a first frame 
of flash LIDAR data is generated from the first reflected light. 
The first frame of flash LIDAR is made up of a first array of 
range data R (K)i as discussed above. The first array of range 
data R^,- corresponds to a first array of distances from the 30 
array of detectors i to a corresponding first set of surface 
coordinates S (n)i . At step 90, an elevation map is selected with 
a mesh 0 defining a plurality of cells k. Consistent with the 
method 30, the mesh 0 is envisioned to be a an array of , . 
1 024x1024 pixels. At step 92, the first array of range data R ()J )( 
is projected onto the mesh, thereby generating a first projec- 
tion array. 

Block 94 designates a transition A from FIG. 18 to FIG. 19. 

At step 96, after a predetermined time interval, a second 40 
emitted laser light is emitted from the flash LIDAR apparatus 
to a second surface. This is the initiation of the generation of 
a second frame of flash LIDAR data. At step 98, a second 
reflected light reflected from the second surface is captured by 
the array of detectors i of the flash LIDAR apparatus. At step 45 
100, a second frame of flash LIDAR data is generated from 
the second reflected light, the second frame of flash LIDAR 
data being made up of a second array of range data R ( „ +i:)i . 
The second array of range data R ()I+1)! corresponds to a sec- 
ond array of distances from the array of detectors i to a 50 
corresponding second set of surface coordinates S (M+1)i . 

Block 102 indicates a transition B from FIG. 19 to FIG. 20. 

At step 104, the second array of range data R ( „ +1)l - is pro- 
jected onto the mesh 0, generating a second projection array. 

At step 106, the first projection array is correlated with the 55 
second projection array to calculate an optical offset therebe- 
tween using at least the predetermined interval. The optical 
offset also is referred to as an optical flow, because it identifies 
the change in the field of view of the detector from the first 
frame of LIDAR data to the second frame of LIDAR data. At 60 
step 108, the optical offset, among other parameters, is pro- 
vided to a navigation apparatus as input for navigational 
control of the vehicle. The offset may be used, together with 
the range data to calculate variables such as change in vehicle 
attitude, speed, acceleration, etc. As should be apparent to 65 
those skilled in the art, the offset information may be used to 
generate a bevy of different types of information that may be 
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he used for the GNC processor and apparatus of a vehicle, 
specifically a spacecraft. Illustrative method 80 may termi- 
nate or end at block 110. 

Building upon the teachings provided above, the present 
invention also encompasses a method of real time image 
processing and enhancement that is largely independent of 
any particular methodology employed to develop a DEM. 

As should be apparent from the foregoing, the method 30 is 
directed to one contemplated embodiment of a super resolu- 
tion algorithm that was found to be effective in generating a 
DEM of sufficient quality. It is recognized, however, that any 
algorithm mat be employed without departing from the scope 
of the present invention. As should be apparent from the 
foregoing, the minimum parameters that are needed for real 
time image processing are successive frames of LIDAR data 
that have been projected onto a reference frame Q and corre- 
lated with one another. When successive frames of LIDAR 
data are correlated with one another, an elevation map may be 
generated from the range data inherent in the frames of flash 
LIDAR data. 

As a result, the present invention also provides a method of 
real time image processing and enhancement. The method is 
illustrated in FIGS. 21-22. The method is designated 120. 

The method 120 is intended to be performed in successive 
iterations until a predetermined number of frames of flash 
LIDAR data are processed. As noted above, this predeter- 
mined number of frames is contemplated to be about 10 
frames of flash LIDAR data, but this number is not intended 
to be limiting of the present invention. 

As illustrated in FIG. 21, the method 120 starts at step 122. 
The method proceeds to step 124 where, at a predetermined 
time interval, laser light is emitted from a flash LIDAR appa- 
ratus to a surface. At step 126, reflected light reflected from 
the surface is captured by an array of detectors i of the flash 
LIDAR apparatus. At step 128, a frame of flash LIDAR data 
is generated from the reflected light. The frame of flash 
LIDAR data includes an array of range data R Wl . The array of 
range data R (w) , corresponds to an array of distances from the 
array of detectors i to a corresponding set of surface coordi- 
nates At step 130, an elevation map is selected with a 
mesh 0 defining a plurality of cells k. The elevation map is a 
zero elevation map, as discussed above. The elevation map is 
effectively a map of the surface as would be viewed from a 
position directly above the surface. As should be apparent 
from the discussion herein, the elevation map corrects for the 
look angle of the LIDAR apparatus. 

The method 120 transitions from FIGS. 21 to 22 at block 
132. 

At step 134, the array of range data R (M)i is projected onto 
the mesh 0, thereby generating a projection array of range 
data R ( „ )(1 -. At step 136, an array of height data h (M)i . is calcu- 
lated based on the array of range data R ( „ ); and the projection 
array of range data R ( „ ;i .. At step 138, the array of height data 
\,i)k * s correlated with a prior array of height data h (M _ 1;i to 
produce a third array of height data corresponding to an 
elevation map. If there is no prior array of height data h (n _ 1)/t , 
the prior array of height data h (n _ l)k , the prior array of height 
data h (n _ 1)ir is initialized to a zero value. Such a circumstance 
would occur, for example, when the data being analyzed is the 
first frame of LIDAR data. The third array of height data may 
be normalized for each of the predetermined number of 
frames of LIDAR data. As noted, resolution enhancement is 
determined by an asymptotic relationship between the con- 
vergence of the third array of height data and the predeter- 
mined number of frames of flash LIDAR data. 

The method 120 ends at block 140. The method 120 is 
intended to be repeated, as needed, until the third array of 
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height data reaches a level of accuracy acceptable for the 
intended application. Hie level of accuracy involves the 
asymptotic relationship between the convergence of the third 
array of height data, which is proportional to the number of 
frames of LIDAR data. As noted above, the third array of 
height data may be normalized for each of the frames of 
LIDAR data. 

It is noted that the methods 30, 80, 120 of the present 
invention may be employed in circumstances other than those 
sampling terrestrial or extraterrestrial terrains. For example, 
the methods of the present invention may be employed to 
assist craft to dock with one another. In such a case, the 
“terrain” might be a space dock. For example. In still other 
applications, the method of the present invention may be 
employed to assist robotic arms to find specific features on a 
device. For example, the methods of the present invention 
mi gilt be employed where a robot is required to manipulate a 
bolt. The methods of the present invention may be employed 
to assist the robot to find the bolt (or “terrain”) that is the 
object of the specific manipulation that has been pro- 
grammed. 

In keeping with the foregoing discussion, the term 
“vehicle” is intended to encompass a robot, robotic arm, or 
other “vehicle” that requires guidance and control vis-a-vis 
the methods of the present invention. 

While preferred embodiments and example configurations 
of the invention have been herein illustrated, shown and 
described, it is to be appreciated that various changes, rear- 
rangements and modifications may be made therein, without 
departing from the scope of the invention as defined by the 
appended claims. It is intended that the specific embodiments 
and configurations disclosed are illustrative of the preferred 
and best modes for practicing the invention, and should not be 
interpreted as limitations on the scope of the invention as 
defined by the appended claims and it is to be appreciated that 
various changes, rearrangements and modifications may be 
made therein, without departing from the scope of the inven- 
tion as defined by the appended claims. 

What is claimed as new and desired to be secured by 
Letters Patent of the United States is: 

1. A non-transitory computer-readable medium compris- 
ing computer-executable instructions that when executed by a 
processor, cause the processor to perform: 

emitting a first emitted laser light from a flash LIDAR 
apparatus to a first surface; 

capturing a first reflected light reflected from the first sur- 
face by an array of detectors of the flash LIDAR appa- 
ratus; 

generating a first frame of flash LIDAR data from the first 
reflected light, the first frame of flash LIDAR compris- 
ing a first array of range data, wherein the first array of 
range data corresponds to a first array of distances from 
the array of detectors to a corresponding first set of 
surface coordinates; 

selecting an elevation map with a mesh defining a plurality 
of cells; 

projecting the first array of range data onto the mesh, 
thereby generating a first projection array; 

emitting a second emitted laser light from the flash LIDAR 
apparatus to a second surface after a predetermined time 
interval; 

capturing a second reflected light reflected from the second 
surface by the array of detectors of the flash LIDAR 
apparatus; 

generating a second frame of flash LIDAR data from the 
second reflected light, the second frame of flash LIDAR 
data comprising an second array of range data, wherein 
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the second array of range data corresponds to a second 
array of distances from the array of detectors to a corre- 
sponding second set of surface coordinates; 
projecting the second array of range data onto the mesh, 

5 thereby generating a second projection array; 

calculating a previously unknown optical offset by corre- 
lating the first projection array with the second projec- 
tion array using at least the predetermined time interval; 
and 

1 0 based upon the optical offset, calculating a change in posi- 
tion of a vehicle, wherein the change in position is con- 
figured to be provided to a navigation apparatus as input 
for navigational control of the vehicle. 

15 2. The non-transitory computer-readable medium of claim 

1 , wherein an operational frequency of the flash LIDAR appa- 
ratus is 30 Hz and the predetermined time interval is inversely 
proportional to the operational frequency and 1 /3</ , ’ of a sec- 
ond. 

20 3 . The non-transitory computer-readable medium of claim 

1, further comprising: 

calculating a variable for the navigation control of the 
vehicle. 

4. The non-transitory computer-readable medium of claim 

25 3, wherein the variable comprises the vehicle’s attitude. 

5. The non-transitory computer-readable medium of claim 
3, wherein the variable comprises the vehicle’s speed. 

6. The non-transitory computer-readable medium of claim 
3. wherein the variable comprises the vehicle’s acceleration. 

,( 1 7. The non-transitory computer-readable medium of claim 

3, the vehicle having an attitude, a speed and an acceleration, 
and wherein the variable comprises the attitude, speed and 
acceleration. 

35 8 . The non-transitory computer-readable medium of claim 

3, further comprising: 

providing a visualization processor; and 
generating a visual representation with the visualization 
processor from the optical offset. 

40 9 . The non-transitory computer-readable medium of claim 

1, wherein the vehicle comprises a spacecraft, a robot, or a 
robotic arm. 

10. A non-transitory computer-readable medium compris- 
ing computer-executable instructions that when executed by a 

45 processor, cause the processor to perform: 

(a) emitting a laser light from a flash LIDAR apparatus to 
a surface at a predetermined time interval, wherein the 
flash LIDAR apparatus comprises a plurality of detec- 
tors; 

50 (b) caphiring a reflected light reflected from the surface by 

the plurality of detectors of the flash LIDAR apparatus; 

(c) generating an array of range data points from the 
reflected light, wherein a range data point is calculated 
as an average of the distances from the plurality of points 

55 on the surface to the corresponding plurality of detectors 

of the LIDAR apparatus; 

(d) selecting an elevation map with a mesh defining a 
plurality of cells corresponding to the plurality of points 
on the surface; 

60 (e) generating a projection array of range data points by 

projecting the array of range data points onto the mesh; 
(f) calculating an array of height data based on the array of 
range data points and the projection array of range data 
points; and 

65 (g) correlating the array of height data with a prior array of 

height data to produce a third array of height data cor- 
responding to the elevation map. 
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11. The non-transitory computer-readable medium of 
claim 10, wherein, if there is no prior array of height data, 
initializing the prior array of height data to zero. 

12. The non-transitory computer-readable medium of 

claim 10, further comprising: 5 

enhancing the resolution of the third height array by repeat- 
ing steps (a) through (e) for a predetermined number of 
frames of flash LIDAR data. 

13. The non-transitory computer-readable medium of 
claim 12, wherein the predetermined number of frames is 10. io 

14. The non-transitory computer-readable medium of 
claim 12, wherein enhancing the resolution of the third height 
array includes normalizing the third height array for each of 
the predetermined number of frames of flash LIDAR data. 

15. The non-transitory computer-readable medium of 15 
claim 12, wherein enhancing the resolution is determined by 
an asymptotic relationship between a convergence of the third 
array of height data and the predetermined number of frames 
of flash LIDAR data. 

16. The non-transitory computer-readable medium of 20 
claim 15, wherein the predetermined number of frames is 10. 

17. A non-transitory computer-readable medium compris- 
ing computer-executable instructions that when executed by a 
processor, cause the processor to perform: 

(a) generating an array of range data points front a laser 
light reflected from a plurality of points on a surface to a 


18 

plurality of detectors of a LIDAR apparatus, wherein a 
range data point is calculated as an average of the dis- 
tances front the plurality of points on the surface to the 
plurality of detectors of the LIDAR apparatus; 

(b) selecting an elevation map with a mesh defining a 
plurality of cells corresponding to the plurality of points 
on the surface; 

(c) generating a projection array of range data points by 
projecting the array of range data onto the mesh; 

(d) calculating an array of height data based on the array of 
range data points and the projection array of range data 
points; 

(e) correlating the array of height data with a prior array of 
height data to produce a third array of height data cor- 
responding the elevation map; 

enhancing the resolution of the third height array by repeat- 
ing steps (a) through (e) for a predetermined number of 
frames of flash LIDAR data, wherein the predetermined 
number of frames of 10. 

18. The non-transitory computer-readable medium of 
claim 17, wherein enhancing the resolution is determined by 
an asymptotic relationship between a convergence of the third 
array of height data and the predetermined number of frames 
of flash LIDAR data. 



